RENT—Repeated Elastic Net Technique for Feature Selection

نویسندگان

چکیده

Feature selection is an essential step in data science pipelines to reduce the complexity associated with large datasets. While much research on this topic focuses optimizing predictive performance, few studies investigate stability context of feature process. In study, we present Repeated Elastic Net Technique (RENT) for Selection. RENT uses ensemble generalized linear models elastic net regularization, each trained distinct subsets training data. The based three criteria evaluating weight distributions features across all elementary models. This fact leads high that improve robustness final model. Furthermore, unlike established selectors, provides valuable information model interpretation concerning identification objects are difficult predict during training. our experiments, benchmark against six selectors eight multivariate datasets binary classification and regression. experimental comparison, shows a well-balanced trade-off between performance stability. Finally, underline additional interpretational value exploratory post-hoc analysis healthcare dataset.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A feature selection technique for classificatory analysis

Patterns summarizing mutual associations between class decisions and attribute values in a pre-classified database, provide insight into the significance of attributes and also useful classificatory knowledge. In this paper we have proposed a conditional probability based, efficient method to extract the significant attributes from a database. Reducing the feature set during pre-processing enha...

متن کامل

A New Framework for Distributed Multivariate Feature Selection

Feature selection is considered as an important issue in classification domain. Selecting a good feature through maximum relevance criterion to class label and minimum redundancy among features affect improving the classification accuracy. However, most current feature selection algorithms just work with the centralized methods. In this paper, we suggest a distributed version of the mRMR featu...

متن کامل

Regularization and variable selection via the elastic net

We propose the elastic net, a new regularization and variable selection method. Real world data and a simulation study show that the elastic net often outperforms the lasso, while enjoying a similar sparsity of representation. In addition, the elastic net encourages a grouping effect, where strongly correlated predictors tend to be in or out of the model together.The elastic net is particularly...

متن کامل

Model Selection in Undirected Graphical Models with the Elastic Net

Structure learning in random fields has attracted considerable attention due to its difficulty and importance in areas such as remote sensing, computational biology, natural language processing, protein networks, and social network analysis. We consider the problem of estimating the probabilistic graph structure associated with a Gaussian Markov Random Field (GMRF), the Ising model and the Pott...

متن کامل

Adaptive Elastic Net: An Improvement of Elastic Net

Lasso proved to be an extremely successful technique for simultaneous estimation and variable selection. However lasso has two major drawbacks. First, it does not capture any grouping effect and secondly in some situations lasso solutions are inconsistent. To overcome inconsistency recently adaptive lasso was proposed where adaptive weights are used for penalizing different coefficients. Adapti...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2021

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2021.3126429